Information transmission method, information transmission apparatus, information recording or reproducing method, information recording or reproducing apparatus and recording medium

ABSTRACT

An information transmission method capable of reproducing the atmosphere of a concert hall or a live performance hall, wherein bio-information of a speaker, player, actor or conductor, who serves as a source of speech, sounds or music and/or bio-information of a performer included within an image are multiplexed with respect to information of speech or music and/or information of the image for transmission thereof. At the receiving side, sense stimulation based on the bio-information is provided to the viewer, or information of speech or music and/or information of the image are controlled on the basis of the bio-information to thereby reproduce presence or live appeal.

CROSS-REFERENCE TO RELATED APPLICATIONS

The present application is a national stage application under 35 U.S.C.§371 of International Application No. PCT/JP03/15885, filed Dec. 11,2003, which claims priority from Japanese Application No. JP2003-009646, filed Jan. 17, 2003, the disclosures of which are herebyincorporated by reference herein.

BACKGROUND OF THE INVENTION

1. Technical Field

The present invention relates to a method for performing transmissionof, e.g., information of speech (sound) and/or music, and/or informationof image and an apparatus therefor, relates to an information recordingor reproducing method and an information recording or reproducingapparatus, and relates to a recording medium.

2. Background Art

Hitherto, there have been performed methods to record information ofmusic or image at classic concert or jazzing live performance, etc. ontorecording medium such as CD (Compact Disc) or DVD (Digital VersatileDisc), etc., or to perform transmission of such music or imageinformation by a method such as broadcast, etc.

Even if information obtained by reproducing information of music orimage recorded on the CD or DVD is viewed, or even if live broadcastingprogram of live performance is viewed, reproduction in such viewing formis far from live appeal which has been actually viewed at the concerthall or the live hall. It is considered that the atmosphere of theconcert hall or the live hall is not directly transmitted to viewers forreproduction information and/or viewers for broadcasting program.

For this reason, even if, e.g., the technology of the Japanese PatentApplication Laid Open No. 2001-57672 is used to detect, asbio-information (bioinformation), feeling with respect to reproductioninformation or broadcasting program of viewer of the reproductioninformation or viewer of the broadcasting program to control thereproduction information or the broadcasting information on the basis ofthe detection output, it is impossible to reproduce the atmosphere ofthe concert hall or the live hall. The reason thereof is that viewer ofreproduction information and/or viewer of broadcasting program do notexist at the concert hall or the live hall.

As stated above, hitherto, even if live sound recording is performed, orlive program is broadcasted, it was impossible to transmit theatmosphere of the concert hall or live hall at the time of reproductionof the live sound recording or to viewers of the live program.

SUMMARY OF THE INVENTION

An object of the present invention is to provide a novel informationtransmission method and a novel information transmission apparatus, anovel information recording or reproducing method and a novelinformation recording or reproducing apparatus, and a novel recordingmedium which can solve the problems that prior arts as described abovehave.

The present invention is directed to an information transmission methodof performing transmission of audio information and/or video (image)information in the state where bio-information of a participator presentat the place where those information are acquired is multiplexed withrespect to the audio information and/or the video information.

Here, the participator is speaker, player, actor or conductor who servesas providing (sending) source of audio information, and/or performer(actor, actress) or photographed person included in image.

Further, listener present at the place where audio information isacquired and/or viewing person present at the place where videoinformation is acquired are included in the participator.

In the information transmission method according to the presentinvention, transmission of bio-information is performed in a mannerassociated with audio information and/or video information correspondingto a timing where the bio-information has been caused to take place.Here, audio information and/or video information, and bio-informationare partitioned every time period of the same predetermined time length,and transmission of the partitioned bio-information is performed insynchronism with audio information and/or video information ofcorresponding predetermined time length period.

Moreover, audio information and/or video information may be partitionedevery time period of a predetermined time length to perform statisticalprocessing of bio-information at plural time periods of thepredetermined time length to calculate statistical bio-information(statistically processed bio-information) to perform transmission of thestatistical bio-information in synchronism with audio information and/orvideo information of plural time periods of corresponding predeterminedtime length.

In the information transmission method according to the presentinvention, the bio-information is at least one of body motion(movement), myoelectricity, body surface temperature, skin sweating,skin resistance, pulse, breath, micro-vibration, cardioelectricity,heartbeat, and blood pressure.

The bio-information is extracted from audio information and/or videoinformation. Transmission of the bio-information thus extracted isperformed along with audio information and/or video information.

The information transmission apparatus according to the presentinvention comprises: information acquiring means for acquiring audioinformation and/or video information; bio-information detecting meansfor detecting bio-information of a participator present at the placewhere these information are acquired; and transmission means forperforming transmission of the audio information and/or the videoinformation which have been obtained from the information acquiringmeans and the bio-information which has been obtained from thebio-information detecting means.

The information recording method according to the present inventioncomprises: recording, with respect to a predetermined recording medium,audio information and/or video information, and bio-information of aparticipator present at the place where these information are acquired.

The recording medium used in the information recording method accordingto the present invention is at least one of optical disc, magnetic tape,hard disc and semiconductor memory.

In the information recording method according to the present invention,the bio-information is extracted from audio information and/or videoinformation, and the bio-information thus extracted is recorded alongwith the audio information and/or the video information.

The information recording apparatus according to the present inventioncomprises: information acquiring means for acquiring audio informationand/or video information; bio-information detecting means for detectingbio-information of a participator present at the place where theseinformation are acquired; and recording means for recording, withrespect to a predetermined recording medium, the audio informationand/or the video information which have been obtained from theinformation acquiring means and the bio-information which has beenobtained from the bio-information detecting means.

In the information recording apparatus according to the presentinvention, the recording means records bio-information with respect tothe recording medium along with audio information and/or videoinformation corresponding to a timing where the bio-information has beencaused to take place.

The recording means serves to partition audio information and/or videoinformation, and bio-information every time period of the samepredetermined time length to record the bio-information thus partitionedalong with audio information and/or video information of correspondingpredetermined time length period.

Further, the recording means serves to partition audio informationand/or video information every time period of a predetermined timelength to perform statistical processing of bio-information at pluraltime periods of the predetermined time length to calculate statisticalbio-information to record the statistical bio-information along withaudio information and/or video information of plural time periods of thecorresponding predetermined time length.

As the recording medium, there is used at least one of optical disc,magnetic tape, hard disc and semiconductor memory.

The bio-information detecting means serves to extract bio-informationfrom audio information and/or video information.

The information reproducing method according to the present inventioncomprises: reproducing audio information and/or video information tooffer the information thus obtained to user, and to give, to the user,sense stimulation based on bio-information of a participator present atthe place where the audio information and/or the video information areacquired.

In the information reproducing method according to the presentinvention, audio information and/or video information, andbio-information are received through a transmission medium.

Here, the audio information and/or the video information, and thebio-information are read out from the recording medium.

In the information reproducing method according to the presentinvention, the participator is a listener present at the place whereaudio information is acquired and/or a viewing person present at theplace where video information is acquired, whereby the audio informationand/or the video information are controlled on the basis ofbio-information of the participator present at the place where the audioinformation and/or the video information are acquired to reproduce thoseinformation. Here, the audio information and/or the video informationand the bio-information are received through transmission medium.

The information reproducing apparatus according to the present inventioncomprises: means for reproducing audio information and/or videoinformation to offer the information thus reproduced to user; and meansfor giving, to the user, sense stimulation based on bio-information of aparticipator present at the place where the audio information and thevideo information are acquired.

The information reproducing apparatus further comprises receiving meansfor receiving audio information and/or video information, andbio-information through a transmission medium.

The information reproducing apparatus according to the present inventioncomprises: means for reading out, from a receiving medium, audioinformation and/or video information, and bio-information.

The information reproducing apparatus according to the present inventioncomprises reproducing means for controlling audio information and/orvideo information on the basis of bio-information of a participatorpresent at the place where the audio information and/or videoinformation are acquired to reproduce those information. In theinformation reproducing apparatus, there is provided receiving means forreceiving audio information and/or video information, andbio-information through a transmission medium. Moreover, the informationreproducing apparatus comprises means for reading out, from therecording medium, audio information and/or video information, andbio-information.

The present invention is directed to a recording medium, and is adaptedso that audio information and/or video information, and bio-informationof a participator present at the place where these information areacquired are recorded.

Still further objects of the present invention and practical meritsobtained by the present invention will become more apparent from thedescription of the embodiments which will be given below with referenceto the attached drawings.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 is a view for explaining the environment to which an informationtransmission apparatus according to the present invention is applied.

FIG. 2 is a block diagram showing the information transmission apparatusaccording to the present invention.

FIGS. 3A and 3B are views for explaining formats of information causedto undergo transmission by an information transmission method accordingto the present invention.

FIG. 4 is a block diagram showing an information recording apparatusaccording to the present invention.

FIG. 5 is a block diagram showing an information reproducing apparatusaccording to the present invention.

FIG. 6 is a block diagram showing another example of the informationreproducing apparatus according to the present invention.

FIG. 7 is a block diagram showing a further example of the informationreproducing apparatus according to the present invention.

FIG. 8 is a block diagram showing another example of the informationtransmission apparatus according to the present invention.

DETAILED DESCRIPTION BEST MODE FOR CARRYING OUT THE INVENTION

The information transmission method and the information transmissionapparatus, the information recording method and the informationrecording apparatus, and information reproducing method and informationreproducing apparatus according to the present invention, and recordingmedium according to the present invention will now be described inpractical sense with reference to the attached drawings.

The information recording method and the information recording apparatusaccording to the present invention which will be explained below arecaused to perform, through Internet, transmission of information ofspeech (sound) or music (hereinafter simply referred to as musicinformation for the brevity of explanation) which have been recorded atthe classic concert.

FIG. 1 is a view showing an example of the state of a concert hall. Aconductor 1 waves baton, and listeners 3 listen to performance of anorchestra 2. Further, plural microphones 4 are installed (provided) atsuitable positions as sound collection of music information ofrespective channels such as center channel, left channel and rightchannel, etc., and serve to collect sounds of music by performance ofthe orchestra.

In the method and the apparatus for recording information according tothe present invention, in order to transmit atmosphere of the concert,bio-information such as body motion (movement), breath, pulse, bloodpressure, body surface temperature, skin sweating and/or skinresistance, etc. of the conductor 1, a predetermine player, e.g.,concert master, etc. of the orchestra 2, and listener of, e.g., bestlistening position located at a predetermined position among listeners 3are detected to perform transmission of those bio-information along withmusic information.

For example, it is general that, e.g., body motion (movement) or breathof the conductor is synchronized with rhythm or tempo, etc. of music tobe played or performed. It is deemed that when, e.g., there is a desireto conduct performance of slow melody, body motion and/or breath becomeslow in harmony therewith, and when shift to big sound is suddenlyperformed, body motion becomes great in harmony therewith, and breathingalso changes in harmony therewith such that breath is once stopped toshift from inspiration to expiration at a stroke.

It is expected that, at the part of rhythm or tempo suddenly changing,body motion and/or breath of player suddenly change in harmonytherewith, and at the slow melodious part, body motion and/or breathslowly change in harmony therewith. It is considered that when shift tobig sound is suddenly performed, great changes may be performed at astroke with respect to body motion and/or breath in the state whereattention is drawn to baton of the conductor.

It is considered that in the case where player such as singer, etc.,exists, that player is also caused to undergo body motion in accordancewith rhythm of music or image in music, etc., whereby information ofthat breathing (breath) gives presence.

Further, it is considered that there is performed a change such thatpulse and/or heartbeat become many and skin sweating becomes many at themusic part where mood is raised or enhanced, and pulse and/or heartbeatslowly become stable at slow music part.

It is expected that if information of breathing and/or body motion ofconductor, player and/or actor or actress, and/or emotional informationof listeners which have been stated above can be transmitted to the sideof listener who listens to information obtained by receiving transmittedaudio information to reproduce them, presence of live performance can betransmitted as it is.

In view of the above, in the present invention, e.g., acquisition ofbio-information which will be explained below is performed.

First, a biosensor (body motion sensor) for detecting body motion ormovement of the conductor is provided at, e.g., a conductor table 1 a onwhich the conductor 1 stands up. Moreover, biosensor (breath sensor) fordetecting breath of the conductor is provided at, e.g., the conductortable 1 a or a score table 1 b.

For example, the body motion can be detected by a method using opticalsensor, or a method of detecting motion information of image withrespect to picked up image from image pick-up device, etc. Since breathhas frequency component of a relatively low specific range, e.g.,microphone is embedded at the conductor table 1 a or the score table 1 bof the conductor 1, or microphone is embedded at the back side of awatch that the conductor 1 attaches to detect vibration of frequencycomponent of the specific range, thereby making it possible to detectbreath.

It is to be noted that it is desirable to have ability to detectbio-information at low impact with respect to human body.

Moreover, biosensors such as body motion sensor and/or breath sensor,etc. are similarly provided also with respect to a predetermined player,e.g., concert master of the orchestra 2 so that body motion and/orbreath of the player are detected. It is a matter of course that thosebiosensors may be provided with respect to all persons of (orchestra)members constituting the orchestra to detect body motion and/or breathof respective members of the orchestra. Further, in the case where actoror actress such as singer, etc., exists, transmission of body motion,breath and/or other bio-information of that singer may be performed.

In addition, in the present invention, biosensors such accelerationpulse wave sensor, heartbeat sensor and/or breath sensor, etc. areattached with respect to a listener of a predetermined position amonglisteners 3, e.g., listener located at the position where listeningenvironment is the best at the concert hall so that bio-information ofthe concerned listener are detected.

FIG. 2 is a block diagram showing a configuration example of aninformation transmission apparatus according to the present invention.In this example, there is employed the configuration that transmissionof recorded playing music information of the orchestra is performedthrough Internet along with bio-information of conductor, player, actoror actress and/or listener.

Audio signals from plural microphones 4 for collecting sounds of playingmusic of the orchestra, i.e., audio signals of respective channels suchas center channel, left channel and right channel, etc. are respectivelydelivered to A/D converters 6 through amplifiers 5, at which they areconverted into digital audio signals.

The digital audio signals corresponding to plural channels from theplural A/D converters 6 are delivered to an audio multiplexing encoder7, at which they are caused to undergo multiplexing-encode processing.Thereafter, the signal thus obtained is delivered to a multiplexingprocessing unit 8 for transmission. At the audio multiplexing encoder 7,there are included processing for compressing audio data and/or formodulating audio data for the purpose of transmission, etc.

On the other hand, in FIG. 2, biosensors A1 to Ai are sensors foracquiring bio-information of the conductor 1. Bio-information, e.g.,body motion, breath and body surface temperature, etc. which have beendetected at the respective biosensors A1 to Ai are delivered to abio-information analysis processing unit 11A, at which they areanalyzed. The analyzed results of the bio-information are delivered tothe transmission multiplexing processing unit 8. It is to be noted thatbio-information may be delivered to the transmission multiplexingprocessing unit 8 after undergone compression.

Moreover, biosensors B1 to Bj are sensors for acquiring bio-informationof a player such as concert master, etc. in this example.Bio-information, e.g., body motion, breath and body surface temperature,etc. which have been detected at respective biosensors B1 to Bj aredelivered to a bio-information analysis processing unit 11B, at whichthey are analyzed. The analyzed results of the bio-information aredelivered to the transmission multiplexing processing unit 8.

Further, biosensors C1 to Ck are sensors for acquiring bio-informationof listener located at the best listening position. Bio-information,e.g., body motion, breath and body surface temperature, etc. which havebeen detected at the respective biosensors C1 to Ck are delivered to abio-information analysis processing unit 11C, at which they areanalyzed. The analyzed results of the bio-information are delivered tothe transmission multiplexing processing unit 8.

At the transmission multiplexing processing unit 8, audio informationand bio-information are respectively packetized and multiplexed. FIG. 3Ais a diagram for explaining one example of multiplexed packet data. Inthe case of this example, audio data are partitioned every predeterminedtime length and are compressed. In addition, the compressed audio datacorresponding to predetermined time length are packetized. Thus, audiodata packets are provided.

Moreover, analysis processing results of bio-information of conductor,player (or actor or actress) and/or listener at time period of the samepredetermined time length as that of audio data from the bio-informationanalysis processing units 11A, 11B, 11C are respectively delivered tothe transmission multiplexing processing unit 8 as bio-information A,bio-information B and bio-information C.

The transmission multiplexing processing unit 8 packetized respectivebio-information A, B and C to insert the information thus packetizedinto areas caused to be empty in terms of time by, e.g., compression ofaudio signal as shown in FIG. 3A to multiplex such information thusobtained with respect to audio data packet. In this case, in thisembodiment, packets of the bio-information A, the bio-information B andthe bio-information C are inserted into portions after the audio datapackets of corresponding predetermined time length period. Thus,transmission of the packet data thus obtained is performed insynchronism with audio data.

The audio signal and the bio-information from the transmissionmultiplexing processing unit 8 are sent to, e.g., communication network,Internet 10 in this example through a communication interface 9.

It is expected that in the case where transmission of thebio-information A, the bio-information B and the bio-information C isperformed in synchronism with audio data in a manner as stated above,when audio data is reproduced on the real time basis at the receivingside of transmission data also as described later, processing using thebio-information A, the bio-information B and the bio-information C whichhave been synchronized is performed, thereby making it possible toeasily reproduce the atmosphere of live performance of the concert alsoat the receiving side of transmission data.

It is to be noted that in the case where transmission of packets of thebio-information A, the bio-information B and the bio-information C isperformed in synchronism with audio data, packets of the bio-informationA, the bio-information B and the bio-information C may be inserted intoportion before audio data packet of corresponding predetermined timelength period.

It should be noted that in the case where transmission data istemporarily written with respect to memory or recording medium to readout such transmission data at a later time point to reproduce them inplace of reproducing transmission data on the real time basis at thereceiving side of transmission data, if transmission of packet of audiodata and packets of the bio-information A, the bio-information B and thebio-information C is performed in such a manner that correspondencerelationship between both (two kinds of) packets can be recognized,there is no necessity to synchronously perform transmission of the both(two kinds of) packets in a manner close in point of time, but, e.g.,transmission of packets of the bio-information A, the bio-information Band the bio-information C with respect to respective audio data packetsmay be also collectively performed, e.g., at the last of audio datapacket corresponding to one movement.

In this case, it is necessary that transmission of both (two kinds of)packets is performed in the state where they can be associated with eachother by a method such that correspondence relation data betweenrespective audio data packets and packets of the bio-information A, thebio-information B and the bio-information C are separately recorded,etc.

Moreover, in place of superimposing bio-information A, bio-information Band bio-information C every one packet of audio data, statisticalprocessing of bio-information with respect to audio data correspondingto a predetermined time length serving as plural packets may be alsoperformed at bio-information analysis processing units 11A, 11B, 11C tomultiplex such statistically processed bio-information as transmissiondata.

FIG. 3B is a view showing an example of transmission information in thatcase, and bio-information As, Bs, Cs are results obtained by performingstatistical processing, e.g., averaging processing of bio-information A,B, C at time period corresponding to n number of audio data packetstherebefore over the time period.

It is to be noted that while body motion and/or breath, etc. are used asbio-information in the above-described explanation, the presentinvention is not limited to such body motion and/or breath, but, e.g.,myoelectricity, body surface temperature, sweating of skin, skinresistance, pulse, cardioelectricity and/or heartbeat, etc. may be usedas bio-information acquired from conductor, player and/or actor oractress, etc.

With respect to listener considered to be placed in relativelystationary state, biochemical reaction, brain waves,magneto-encephalogram, pulse, micro-vibration and/or blood pressure,etc. may be acquired as bio-information in addition to body motion,breath, myoelectricity, body surface temperature, sweating of skin, skinresistance, pulse, cardioelectricity and/or heartbeat, etc.

As bio-information, it is unnecessary to acquire plural kinds ofinformation as in the case of the above described example, but, e.g.,only body motion, only breath or only heartbeat may be employed.

It is to be noted that while transmission of bio-information ofconductor, player, actor or actress and/or listener is performed alongwith audio data in the above-described explanation, it is notnecessarily required to all perform transmission of bio-information ofthree persons of conductor, player, etc. and listener, but transmissionof bio-information with respect to only conductor, only player, or actoror actress, or only listener may be performed along with audio data, ortransmission of arbitrary two kinds of bio-information selected from theabove-mentioned three kinds of bio-information may be performed alongwith audio data.

The present invention is not limited to a system of performingtransmission of audio data and bio-information through network such asInternet, etc. in a manner as stated above, there may be employed asystem of making recording with respect to recording medium to offer therecorded data and information to user. The information recording methodand the information recording apparatus of this example can be caused tobe of the configuration similar to the above-described informationtransmission method and the information transmission apparatus exceptthat the fact that information are recorded with respect to therecording medium is different in place of performing transmission ofinformation.

FIG. 4 shows another example of the information recording apparatusaccording to the present invention. In the example shown in FIG. 4, thetransmission multiplexing processing unit 8 is recording multiplexingprocessing unit 8R, but the components of the preceding stage of themultiplexing processing unit 8R are entirely the same components of theinformation transmission apparatus shown in FIG. 2. The recordingmultiplexing processing unit 8R of this example includes modulationprocessing for recording and/or data compression processing.

In the example shown in FIG. 4, audio data and bio-information whichhave been multiplexed from the recording multiplexing processing unit 8Rare delivered to an information writing unit 13 through a recordingamplifier 12. The information writing unit 13 writes, with respect to arecording medium 14, the audio data and the bio-information which havebeen multiplexed.

Here, as the recording medium 14, there may be used, e.g., optical discsuch as CD-R, CD-RW, DVD, etc., magnetic tape, hard disc, IC card,and/or semiconductor memory such as card-type memory, etc.

In the case of this example, as output data of the recordingmultiplexing processing unit 8R, information packet stream as shown inFIG. 3 are written with respect to recording tracks or memory in thestate where the output data remains to be stream thereof. In thisinstance, the recording area on the recording medium, or the memory areaof the memory may be divided into the area for audio data and the areafor bio-information to write the audio data and the bio-information in aseparate manner.

In that case, when the recording medium is optical disc, the opticalhead is moved at a high speed onto the recording area for audio data andthe recording area for bio-information to perform recording operation.When the recording medium is magnetic tape, magnetic recording head foraudio data and magnetic recording head for bio-information are providedto record the audio data and the bio-information with respect torespective recording areas. Moreover, in the case where audio data andbio-information are written with respect to the memory, after audio datais written into the audio data memory area, address is changed to writebio-information into bio-information memory area.

Further, in the case where recording operation is performed onto theoptical disc, or in the case where write operation is performed withrespect to the memory, there may be also employed an approach such thatafter audio data have been all recorded, all of bio-information arewritten with respect to the bio-information recording area of theoptical disc or the bio-information memory area of the memory.

It is to be noted that, also in both cases, information ofcorrespondence relationship between audio data packet and correspondingbio-information packet is together recorded with respect to therecording medium or the memory. This is because it is necessary thataudio data and bio-information are reproduced at the time ofreproduction in the state where they are associated with each other inpoint of time.

Then, explanation will be given in connection with the example of thecase of an information reproducing apparatus adapted for receivingmultiplexed data of audio data and bio-information which have been sentto Internet to reproduce the audio data by the information transmissionapparatus having the configuration as shown in FIG. 2. Several examplesof information reproducing method and information reproducing apparatusexist depending upon way of utilization of bio-information at the timeof reproduction.

The information reproducing method and the information reproducingapparatus are adapted to convert received bio-information into one orplural senses of visual sense, listening sense, sense of smell, sense oftouch, and sense of taste to offer the sense or senses thus obtained tolistener of reproduction information to thereby reproduce liveatmosphere or presence of the concert.

FIG. 5 is a block diagram showing a first example of the informationreproducing apparatus. As shown in FIG. 5, packets of audio data andbio-information which have been sent through an Internet 10 aredelivered to a multiplexing decomposition unit 22 through acommunication interface 21, at which those packets are decomposed intoaudio data packet and packets of bio-information A, B, C.

The audio data packet from the multiplexing decomposition unit 22 isdelivered to a multiplexing audio decoding unit 23. Packet ofbio-information A (bio-information of the conductor) from themultiplexing decomposition unit 22 is delivered to a bio-informationdecoding unit 31A, at which it is decoded. Packet of bio-information B(bio-information of player or actor (actress)) is delivered to abio-information decoding unit 31B, at which it is decoded. Packet ofbio-information C (bio-information of listener) is delivered to abio-information decoding unit 31C, at which it is decoded. Further, thebio-information A, B, C thus decoded are delivered to a sensestimulation information generation processing unit 32.

At the multiplexing audio decoding unit 23, audio data is decoded, andis de-multiplexed into audio data of respective channels such as centerchannel, left channel, right channel, etc. The audio data of respectivechannels from the multiplexing audio decoding unit 23 are respectivelydelivered to D/A converters 25 through audio signal processing units 24for respective channels, at which they are converted into analog audiosignals. The analog audio signals thus obtained are sent to audio signaloutput terminals 26 for respective channels.

Further, audio signals of respective channels which have been sent fromthe analog audio signal output terminals 26 are respectively deliveredto speakers 28 for respective channels through power amplifiers 27.Thus, multi-channel surround reproduction thereof is performed.

On the other hand, the sense stimulation information generationprocessing unit 32 generates, on the basis of bio-information A, B, Cinputted thereto, sense stimulation which appeals, to five senses oflistener of reproduced audio signal, biosense such as breathing, bodymotion or degree of excitation of the conductor, etc., biosense such asbreathing, body motion or degree of excitation of player, and biosensesuch as degree of excitation, etc. of listener of live hall. Namely, thesense stimulation information generation processing unit 32 generates,on the basis of bio-information A, B, C inputted thereto, sensestimulation information for providing stimulations, which appeals to oneof five senses or plural ones thereof of listener of reproduced audiosignal.

One or plural sense stimulation providing units 331, 332, . . . 33 m isor are connected to the sense stimulation information generationprocessing unit 32. The sense stimulation providing unit 331 is causedto be, e.g., small speaker, etc. for reproducing breath of the conductoror the player. The sense stimulation providing unit 332 is means forgiving, to listener of reproduced audio signal, e.g. vibrationcorresponding to body motion of conductor, player or actor (or actress),or body motion of listener. The sense stimulation providing unit 332 isconstituted by vibration rendering means in which in the case where,e.g., listener of reproduced audio signal sits down on a chair, thesense stimulation providing unit is attached to the chair to render(give) vibration to sitting listener.

The sense stimulation providing unit 333 may be caused to be an imagedisplay unit. The sense stimulation information generation processingunit 32 generates video information for moving image of the conductor orthe player in correspondence with breath or body motion of theconductor, the player or the actor (actress), or for moving, e.g.,abstracted image on the basis of bio-information of the conductor, theplayer, the actor (actress), or the listener in such a manner toreproduce atmosphere at that place, the degree of excitation, rhythm ortempo to deliver the video information to the sense stimulationproviding unit 333. The image display unit serving as the sensestimulation providing unit 333 serves to display the above-mentionedimage on the picture thereof to offer, to viewing person, as imagestimulation, presence of live performance obtained from bio-informationof the conductor or the player, or bio-information of listener of livehall.

In addition to the above, as the sense stimulation providing unit, theremay be used a unit adapted for changing intensity of light or way ofchange thereof on the basis of bio-information, etc. Further, in thecase of live performance of jazz or lock, there may be employed sensestimulation providing means adapted for reproducing temperature,brightness and/or sweat of that hall, or, e.g., sweat or fevered air ofthe player, etc.

While plural sense stimulation providing units are provided in theexample shown in FIG. 5, a single sense stimulation providing unit maybe provided. At the sense stimulation information generation processingunit 32, there is no necessity of using all of bio-information A of theconductor, bio-information B of the player or the actor (or actress) andbio-information C of the listener. On the basis of either one ofbio-information, or combination of two bio-information, sensestimulation information may be generated.

A listener of an audio signal to be reproduced may designate, withrespect to the sense stimulation information generation processing unit32, bio-information which gives basis for generating sense stimulationas either one of bio-information of the conductor, the player or thelistener, or designate, with respect thereto, such bio-information ascombination of plural bio-information, whereby the sense stimulationinformation generation processing unit 32 generates sense stimulation onthe basis of those designated bio-information.

In this case, when a listener of an audio signal to be reproduceddesires to enjoy reproduction signal with a sense of the conductor, hedesignates bio-information of the conductor; when listener desires toenjoy listening sense at the best listening position, he designatesbio-information of listener; and when listener himself desires to enjoyreproduction signal with a sense of the player, he designatesbio-information of the player, thereby making it possible to enjoydesired atmosphere.

It can be expected that when all of three bio-information aredesignated, it becomes possible to reproduce live appeal of the concerthall.

Also previously described, there also exists the example of the casewhere transmission of either one of bio-information A, B, C orcombination thereof is performed. In the example of the case where suchtransmission is performed, the sense stimulation information generationprocessing unit 32 is operative so that in the case wherebio-information caused to undergo transmission is predetermined inadvance, the sense stimulation information generation processing unit 32serves to generate suitable sense stimulation information which has beendetermined in advance, or is selectively designated by user on the basisof received bio-information.

Then, another example of the information reproducing method and theinformation reproducing apparatus according to the present invention isadapted to perform reproduction control of received audio data on thebasis of received bio-information to offer the audio data thus obtainedto listener, thereby making it possible to reproduce live atmosphere orpresence of the concert.

FIG. 6 is a block diagram showing another example of the informationreproducing apparatus according to the present invention. With respectto the reproducing system for audio data in the information reproducingapparatus shown in FIG. 6, an audio signal control processing units 24Ccapable of controlling an audio signal on the basis of a control signalto be inputted are provided in place of the audio signal processingunits 24 of FIG. 5.

Bio-information decoding units 31A, 31B, 31C for decoding respectivebio-information A, B, C deliver decoded bio-information A, B, C to anaudio control signal generating unit 34 in this example in place of thesense stimulation information generation processing unit 32 shown inFIG. 5.

The audio control signal generating unit 34 generates a control signalfor audio signal on the basis of the bio-information A, B, C which havebeen inputted thereto. As a control signal for audio signal, there areformed control signals for controlling amplitude, phase, and/orfrequency of the audio frequency, and control signals for controllingaudio signal pitch and/or tempo, etc.

For example, at portions such that body motion of the conductor or theplayer is large, and breath thereof also greatly changes, the audiocontrol signal generating unit 34 generates such a control signal tomore emphasize change of amplitude of audio signal. At these portions,there are many cases where change of music is rapid, and/or, e.g., theretakes place a change such that change into large sound volume issuddenly caused from slow and quite music. Such a control to moreemphasize amplitude change of audio signal at that time is performed sothat more live appeal is transmitted.

Moreover, there may be performed such a control to superimpose breathinformation or heartbeat information of the conductor, the player or theactor (or actress) onto an audio signal at a certain level. In thiscase, it can be expected that reproduction would be performed in thestate where so-called “breathing” of the conductor or the player isincluded in music information so that live appeal having presence isincluded in reproduction information.

In the above-described explanation, at the audio control signalgenerating unit 34, there is no necessity of generating a control signalof an audio signal on the basis of all of bio-information A of theconductor, bio-information B of the player and bio-information C of thelistener, but a control signal for an audio signal may be generated onthe basis of either one of bio-information, or on the basis ofcombination of those two bio-information.

Moreover, a listener of an audio signal to be reproduced may designatebio-information serving as source for generating an audio control signalas either one of bio-information of the conductor, the player and thelistener, or combination of plural bio-information thereof with respectto the audio control signal generating unit 34 to generate sensestimulation on the basis of those designated bio-information.

In this case, when a listener of an audio signal to be reproduceddesires to enjoy a reproduction signal with a sense of the conductor, hedesignates bio-information of the conductor; when such a listenerdesires to enjoy listening sense at the best listening position, hedesignates bio-information of listener; and when such a listener himselfdesires to enjoy reproduction signal with a sense of the player, hedesignates bio-information of the player, thereby making it possible toenjoy desired atmosphere.

Further, it can be expected that all of three bio-information aredesignated, presence of the concert hall can be reproduced.

Also previously described, in the example of the case where transmissionof either one of bio-information A, B, C is performed although theexample where transmission of combination of such bio-information isperformed is included, when bio-information caused to undergotransmission is determined in advance, the audio control signalgenerating unit 34 serves to generate a suitable audio control signaldetermined in advance on the basis of received bio-information.

While the above-described respective examples are directed to theexample of the case where audio data and bio-information which have beencaused to undergo transmission through Internet are reproduced, theexample described below is directed to the example of the case whereaudio data and bio-information which have been written with respect tothe recording memory and the memory are reproduced.

In this example, other components are entirely the same as thepreviously described components of FIGS. 5 and 6 except that the portionof the previously described communication interface 21 in the examplesof FIGS. 5 and 6 is replaced by information read-out unit for readingout audio data and/or bio-information from the recording medium or thememory, and reproduction amplifier.

FIG. 7 shows another configuration example of an information reproducingapparatus corresponding to the information reproducing apparatus shownin FIG. 6. This example is directed to the example of the case whereinformation is read out from recording medium 14, wherein audioinformation and bio-information are read out from the recording medium14 by an information read-out unit 41, and the information which hasbeen read out is delivered to multiplexing decomposition unit 22 througha reproduction amplifier 42. The components of the succeeding stage ofthe multiplexing decomposition unit 22 are entirely the same as those ofthe case of FIG. 6.

In the case where the information reproducing apparatus shown in FIG. 7is applied to the above-described information reproducing apparatusshown in FIG. 5, components of the succeeding stage of the multiplexingdecomposition unit 22 are entirely the same as those shown in FIG. 5.

Further, the operations and the effects in the case of the apparatusshown in FIG. 7 are respectively entirely the same as those of theabove-described apparatus shown in FIGS. 5 and 6.

It is to be noted that in the case where audio data and bio-informationare respectively written in recording areas or memory areas which arerespectively separated of the recording medium or the memory whenreproduction is performed from the recording medium in the apparatusshown in FIG. 7, multiplexing decomposition unit 22 is not provided atthe information reproducing apparatus, but the information read-out unit41 serves to distribute audio data and bio-information to multiplexingaudio decoding unit 23 and bio-information decoding units 31A, 31B, 31Cdepending upon whether or not data or information to be read out isaudio data or bio-information.

Further, in the case where the recording medium is magnetic tape, andaudio data and bio-information are recorded with respect to separatetracks, the information reproducing apparatus is caused to be of theconfiguration in which head for reproducing audio data and head forreproducing bio-information are provided, and signal processing systemssuch as read-out unit and/or decoding unit, etc. which are adapted forreproducing respective information are respectively provided at thesucceeding stage of the respective reproduction heads.

While the case where only audio information is subject to transmission,recording and/or reproduction has been explained in the above-describedexplanation, information subject to transmission, recording,reproduction may be only information of image, or may be combination ofaudio information and information of image. For example, the case oflive broadcast of play or drama played at theater, or live recording areexamples thereof. In that case, transmission of bio-information ofplayer and/or bio-information of a person who performs playgoing isperformed along with video information, or such bio-information arerecorded along with video information.

While the present invention is applied to the case of Internet livebroadcast or live recording in the above-described respective examples,there may be also employed such an approach to extract bio-informationof conductor, player and/or actor (actress) from audio informationand/or video information recorded in advance on recording medium, orstored in advance in memory to multiplex those bio-information withrespect to audio information and/or video information to performtransmission thereof.

This is applied to the case where Internet broadcast of audioinformation and/or video information which have been read out from,e.g., recorded recording medium or memory is performed, or audioinformation and/or video information which have been read out fromrecoded recording medium or memory are recorded onto recording medium,or are written into memory.

FIG. 8 is a block diagram showing the configuration of the essentialpart of the information transmission apparatus or the informationrecording apparatus in that case. Namely, audio data and/or video datawhich have been read out from a recording medium 51 by an informationread-out unit 52 are delivered to a decoding unit 54 through areproduction amplifier 53, at which they are decoded.

Further, audio data and/or video data which have been decoded aredelivered to a multiplexing unit 56, and are delivered to abio-information extracting unit 55. The bio-information extracting unit55 serves to extract, from audio data and/or video data, bio-informationsuch as breath and/or body motion, etc. of player or performer such assinger or actor (actress), etc. to deliver the bio-information thusextracted to the multiplexing unit 56.

The multiplexing unit 56 serves to multiplex the bio-information fromthe bio-information extracting unit 55 with respect to the audio dataand/or the video data from the decoding unit 54. Further, transmissionof the multiplexed information thus obtained is performed throughnetwork, or such multiplexed information is recorded onto recordingmedium.

It is to be noted that there may be employed such an approach to controlan audio signal or a video signal which has been reproduced on the basisof bio-information from the bio-information extracting unit 55 similarlyto the example of FIG. 7 in place of performing transmission orrecording.

While, in the above-described explanation, transmission of transmissiondata such as audio data and/or video data, and bio-information, etc. isperformed in the state where they are packetized, it is notindispensable to packetize transmission data. Transmission of audio dataand/or video data and bio-information is performed in the state wheretheir frequency bands are caused to be different from each other, orsuch data and information may be recorded in the same state as above.

In addition, while the above-described example is directed to the caseof Internet live broadcast, etc., it is a matter of course that thepresent invention is not limited to such transmission method.

It is to be noted that while the present invention has been described inaccordance with certain preferred embodiments thereof illustrated in theaccompanying drawings and described in detail, it should be understoodby those ordinarily skilled in the art that the invention is not limitedto embodiments, but various modifications, alternative constructions orequivalents can be implemented without departing from the scope andspirit of the present invention as set forth by appended claims.

INDUSTRIAL APPLICABILITY

As described above, in accordance with the present invention,bio-information of conductor, player, actor (actress), listener orplaygoing person is caused to undergo transmission, or is recorded incombination along with audio information and video information, therebymaking it possible to reproduce the atmosphere of concert hall or livehall by using such bio-information at the side where these informationare reproduced.

1. An information transmission method, comprising: acquiring one or moreof audio information and video information of a music performance at agiven location; detecting, concurrent with the acquiring of the one ormore of audio information and video information of the musicperformance, body motion information indicative of a tempo of music ofthe music performance and bio-information of at least one individualpresent at the given location; partitioning the acquired one or more ofaudio information and video information of the music performance intolengths of partitioned data each of which corresponds to a predefinedtime interval; compressing and packetizing the lengths of partitioneddata into a stream of first data packets having empty regions resultingfrom the compression of the lengths of the partitioned data; performingstatistical processing of the body motion information indicative of thetempo of the music of the music performance and bio-information overpredetermined time intervals corresponding to respective pluralities ofthe first data packets of the one or more of audio information and videoinformation; packetizing the statistically processed body motioninformation indicative of the tempo of the music of the musicperformance and bio-information into respective pluralities of seconddata packets corresponding to the respective pluralities of the firstdata packets; multiplexing the stream of first data packets with thesecond data packets by inserting a respective plurality of second datapackets, which corresponds to one of the predetermined time intervals,into one of the empty regions of the stream that is adjacent to arespective plurality of first data pockets which corresponds to a sameone of the predetermined time intervals; and transmitting themultiplexed stream.
 2. The information transmission method as set forthin claim 1, wherein the at least one individual includes a speaker, aplayer, an actor, an actress, or a conductor who serves as a source ofthe audio information, and/or a performer of a photographed person whois included within the video information.
 3. The informationtransmission method as set for in claim 1, wherein the at least oneindividual includes a listener who is present at the given location whenthe audio information is acquired and/or a viewer present at the givenlocation when the video information is acquired.
 4. The informationtransmission method as set forth in claim 1, wherein the bio-informationselected from the group consisting of myoelectricity, body surfacetemperature, skin sweating, skin pressure, pulse, breath,micro-vibration, cardioelectricity, heartbeat, and blood pressure. 5.The information transmission method as set forth in claim 1, wherein thedetected body motion information indicative of the tempo of the music ofthe music performance and bio-information is extracted from the one ormore of audio information and video information of the musicperformance,
 6. An information transmission apparatus, comprising:information acquiring means for acquiring one or more of audioinformation and video information of a music performance at a givenlocation; detecting means for detecting, concurrent with the acquiringof the one or more of audio information and video information of themusic performance, body motion information indicative of a tempo ofmusic of the music performance and bio-information of at least oneindividual present at the given location; and first packetizing meansfor partitioning the acquired one or more of audio information and videoinformation of the music performance into lengths of partitioned dataeach of which corresponds to a predefined time interval, and forcompressing and packetizing the lengths or partitioned data into astream of first data packets having empty regions resulting from thecompression of the partitioned data; analysis means for performingstatistical processing of the body motion information indicative of thetempo of the music of the music performance and bio-information overpredetermined time intervals corresponding to respective pluralities ofthe first data packets of the one or more of audio information and videoinformation; second packetizing means for packetizing the statisticallyprocessed body motion information indicative of the tempo of the musicof the music performance and bio-information into respective pluralitiesof second data packets corresponding to the respective pluralities ofthe first data packets; multiplexing means for multiplexing the streamof first data packets with the second data packets by inserting arespective plurality of second data packets, which corresponds to one ofthe predetermined time intervals, into one of the empty regions of thestream that is adjacent to a respective plurality of first data packetswhich corresponds to a same one of the predetermined time intervals; andtransmission means for transmitting the multiplexed stream.
 7. Theinformation transmission apparatus as set forth in claim 6, wherein theat least one individual includes a speaker, a player, an actor, or aconductor who serves as a source of the audio information, and/or aperformer or a photographed person who is included within the videoinformation.
 8. The information transmission apparatus as set forth inclaim 6, wherein the at least one individual includes a listener who ispresent at the given location when the audio information is acquiredand/or a viewer present at the given location when the video informationis acquired.
 9. The information transmission apparatus as set forth inclaim 6, wherein the bio-information is selected from the groupconsisting of myoelectricity, body surface temperature, skin sweating,skin resistance, pulse, breath, micro-vibration, cardioelectricity,heartbeat, and blood pressure.
 10. The information transmissionapparatus as set forth in claim 6, wherein the detecting means extractsthe detected body motion information indicative of the tempo of themusic of the music performance and bio-information from the one or moreof audio information and video information of the music performance. 11.An information recording method, comprising: acquiring one or more ofaudio information and video information of a music performance at agiven location; detecting, concurrent with the acquiring of the one ormore of audio information and video information of the musicperformance, body motion information indicative of a tempo of music ofthe music performance and bio-information of at least one individualpresent at the given location; partitioning packetizing the acquired oneor more of audio information and video information of the musicperformance into lengths of partitioned data each of which correspondsto a predefined time interval; compressing and packetizing the lengthsof partitioned data into a stream of first data packets having emptyregions resulting from the compression of the partitioned data;performing statistical processing of the body motion informationindicative of the tempo of the music of the music performance andbio-information over predetermined time interval corresponding torespective pluralities of first data packets of one or more of audioinformation and video information; packetizing the statisticallyprocessed body motion information indicative of the tempo of the musicof the music performance and bio-information into respective pluralitiesof second data packets corresponding to the respective pluralities ofthe first data packets; multiplexing the stream of first data packetswith the second data packets by inserting a respective plurality ofsecond data packets, which corresponds to one of the predetermined timeintervals, into one of the empty regions of the stream that adjacent toa respective plurality of first data packets which corresponds to a sameone of the predetermined time intervals; and recording the multiplexedstream onto a predetermined recording medium.
 12. The informationrecording method as set forth in claim 11, wherein the at least oneindividual includes a speaker, a player, an actor, or a conductor whoserves a source of the audio information, and/or a performer or aphotographed person who is included within the video information. 13.The information recording method as set forth in claim 11, wherein theat least one individual includes a listener who is present at the givenlocation when the audio information is acquired and/or a viewer presentat the given location when the video information is acquired.
 14. Theinformation recording method as set forth in claim 11, wherein thebio-information is selected from the group consisting of myoelectricity,body surface temperature, skin sweating, skin resistance, pulse, breath,micro-vibration, cardioelectricity, heartbeat, and blood pressure. 15.The information recording method as set forth in claim 11, wherein thedetected the recording medium is at least one of optical disc, magnetictape, hard disc and semiconductor memory.
 16. The information recordingmethod as set forth in claim 11, wherein the body motion informationindicative of the tempo of the music of the music performance andbio-information is extracted from the one or more of audio informationand video information of the music performance.
 17. An informationrecording apparatus, comprising: information acquiring means, foracquiring one or more of audio information and video information of amusic performance at a given location; detecting means for detecting,concurrent with the acquiring of the one or more of audio informationand video information of the music performance, body motion informationindicative of a tempo of music of the music performance andbio-information of at least one individual present at the givenlocation; and first packetizing means for partitioning the acquired oneor more of audio information and video information of the musicperformance into lengths of partitioned data each of which correspondsto a predefined time interval, and for compressing and packetizing thelengths of partitioned data into a stream of first data packets havingempty regions resulting from the compression of the partitioned data;analysis means for performing statistical processing of the body motioninformation indicative of the tempo of the music of the musicperformance and bio-information over predetermined time intervalscorresponding to respective pluralities of the first data packets of theone or more of audio information and video information; secondpacketizing means for packetizing the statistically processed bodymotion information indicative of the tempo of the music of the musicperformance and bio-information into respective pluralities of seconddate packets corresponding to the respective pluralities of the firstdata packets; multiplexing means for multiplexing the stream of firstdata packets with the second data packets by inserting a respectiveplurality of second data packets, which corresponds to one of thepredetermined time intervals, into one of the empty regions of thestream that is adjacent to a respective plurality of first data packetswhich corresponds to a same one of the predetermined time intervals; andrecording means for recording the multiplexed stream onto apredetermined recording medium.
 18. The information recording apparatusas set forth in claim 17, wherein the at least one individual includes aspeaker, a player, an actor, or a conductor who serves as a source ofthe audio information, and/or a performer or a photographed person whois included within the video information.
 19. The information recordingapparatus as set forth in claim 17, wherein the at least one individualincludes a listener who is present at the given location when the audioinformation is acquired and/or a viewer present at the given locationwhen the video information is acquired.
 20. The information recordingapparatus as set forth in claim 17, wherein the bio-information isselected from the group consisting of myoelectricity, body surfacetemperature, skin sweating, skin resistance, pulse, breath,micro-vibration, cardioelectricity, heartbeat, and blood pressure. 21.The information recording apparatus as set forth in claim 17, whereinthe recording medium is selected from the group consisting of opticaldisc, magnetic tape, hard disc, and semiconductor memory.
 22. Theinformation recording apparatus as set forth in claim 17, wherein thedetecting means extracts the detected body motion information indicativeof the tempo of the music of the music performance and bio-informationfrom the one or more of audio information and video information.
 23. Aninformation reproducing method, comprising: acquiring one or more ofaudio information and video information of a music performance at agiven location; detecting, concurrent with the acquiring of the one ormore of audio information and video information of the musicperformance, body motion information indicative of a tempo of music ofthe music performance and bio-information of at least one individualpresent at the given location; partitioning the acquired one or more ofaudio information and video information of the music performance intolengths of partitioned data each of which corresponds to a predefinedtime interval; compressing and packetizing the lengths of partitioneddata into a stream of first data packets having empty regions resultingfrom the compression of the lengths of the partitioned data; performingstatistical processing of the body motion information indicative of thetempo of the music of the music performance and bio-information overpredetermined time intervals corresponding to respective pluralities ofthe first data packets of the one or more of audio information and videoinformation; packetizing the statistically processed body motioninformation indicative of the tempo of the music of the musicperformance and bio-information into respective pluralities of seconddata packets corresponding to the respective pluralities of the firstdata packets; multiplexing the stream of first data packets with thesecond data by inserting a respective plurality of second data packets,which corresponds to one of the predetermined time intervals, into oneof the empty regions of the stream that is adjacent to a respectiveplurality of first data packets which corresponds to a same one of thepredetermined time intervals; decomposing a multiplexed data stream intorespective pluralities of first data packets at one or more of audioinformation and video information of a music performance and intocorresponding respective pluralities of second data packets ofstatistically processed body motion information indicative of a tempo ofmusic of the music performance and bio-information, the multiplexed datastream having each respective plurality of second data packets of thestatistically processed body motion information indicative of the tempoof the music of the music performance and bio-information whichcorresponds to a given predetermined time interval being disposedadjacent to a respective plurality of first data packets whichcorresponds to a same predetermined time interval in regions of the datastream resulting from partitioning acquired one or more of audioinformation and video information into lengths of partitioned data eachcorresponding to a predefined time interval and compressing the lengthsof partitioned data, the acquired one or more of audio information andvideo information of the music performance being acquired at aperformance at a given location, the body motion information indicativeof the tempo of the music of the music performance and bio-informationbeing of at least one individual present at the given location and beingdetected concurrent with the acquiring of the one or more of audioinformation and video information, the statistically processed bodymotion information indicative of the tempo of the music of the musicperformance and bio-information being generated by performingstatistical processing of the detected body motion informationindicative of the tempo of the music of the music performance andbio-information over predetermined time intervals corresponding torespective pluralities of the first data packets; reproducing the one ormore of audio information and video information for delivery to a user;providing, to the user, sense stimulation based on the body motioninformation indicative of the tempo of the music of the musicperformance and bio-information concurrent with the delivery of the oneor more of the audio information and video information of the musicperformance; and generating video information for a moving image incorrespondence with the body motion information indicative of the tempoof the music of the music performance.
 24. The information reproducingmethod as set forth in claim 23, wherein the multiplexed data stream isreceived through a transmission method.
 25. The information reproducingmethod as set forth in claim 23, wherein the multiplexed data stream isread out from a recording medium.
 26. The information reproducing methodas set forth in claim 23, wherein the at least one individual includes aspeaker, a player, an actor, or a conductor who serves as a source ofthe audio information, and/or a performer or a photographed person whois included within the video information.
 27. The informationreproducing method as set forth in claim 23, wherein the at least oneindividual includes a listener present at the given location when theaudio information is acquired and/or a viewer present at the givenlocation when the video information is acquired.
 28. An informationreproducing method, comprising: acquiring one or more of audioinformation and video information of a music performance at a givenlocation; detecting, concurrent with the acquiring of the one or more ofaudio information and video information of the music performance, bodymotion information indicative of a tempo of music of the musicperformance and bio-information of at least one individual present atthe given location; partitioning the acquired one or more of audioinformation and video information of the music performance into lengthsof partitioned data each of which corresponds to a predefined timeinterval; compressing and packetizing the lengths of partitioned datainto a stream of first data packets having empty regions resulting fromthe compression of the lengths of the partitioned data; performingstatistical processing of the body motion information indicative of thetempo of the music of the music performance and bio-information overpredetermined time intervals corresponding to respective pluralities ofthe first data packets of the one or more of audio information and videoinformation; packetizing the statistically processed body motioninformation indicative of the tempo of the music of the musicperformance and bio-information into respective pluralities of seconddata packets corresponding to the respective pluralities of the firstdata packets; multiplexing the stream of first data packets with thesecond data packets by inserting a respective plurality of second datapackets, which corresponds to one of the predetermined time intervals,into one of the empty regions of the stream that is adjacent to arespective plurality of first data packets which corresponds to a sameone of the predetermined time intervals; decomposing a multiplexed datastream into respective pluralities of first data packets of one or moreof audio information and video information of a music performance andinto corresponding respective pluralities of second data packets ofstatistically processed body motion information indicative of a tempo ofmusic of the music performance and bio-information, the multiplexed datastream having each respective plurality of second data packets of thestatistically processed body motion information indicative of the tempoof the music of the music performance and bio-information whichcorresponds to a given predetermined time interval being disposedadjacent to a respective plurality of first data packets whichcorresponds to a same predetermined time interval in regions of the datastream resulting from partitioning acquired one or more at audioinformation and video information of the music performance into lengthsof partitioned data each corresponding to a predefined time interval andcompressing the lengths of partitioned data, the acquired one or more ofaudio information and video information being acquired at a performanceat a given location, the body motion information indicative of the tempoof the music of the music performance and bio-information being of atleast one individual present at the given location and being detectedconcurrent with the acquiring of the one or more of audio informationand video information, the statistically processed body motioninformation indicative of the tempo of the music of the musicperformance and bio-information being generated by performingstatistical processing of the detected body motion informationindicative of the tempo of the music of the music performance andbio-information over predetermined time intervals corresponding torespective pluralities of the first data packets; controlling, based onthe body motion information indicative of the tempo of the music of themusic performance and bio-information, reproduction of the one or moreof audio information and video information of the music performance; andgenerating video information for a moving image in correspondence withthe body motion information indicative of the tempo of the music of themusic performance.
 29. The information reproducing method a set forth inclaim 28, wherein the multiplexed data stream is are received through atransmission medium.
 30. The information reproducing method as set forthin claim 28, wherein the multiplexed data stream is read out from arecord medium.
 31. The information reproducing method as set forth inclaim 28, wherein the at least one individual includes a speaker, aplayer, an actor, or a conductor who serves as a source of the audioinformation, and/or a performer or a photographed person who is includedwithin the video information.
 32. The information reproducing method asset forth in claim 28, wherein the at least one individual includes alistener present at the given location when the audio information isacquired and/or a viewer present at the given location when the videoinformation is acquired.
 33. A system, comprising: an informationprocessing apparatus, including: information acquiring means foracquiring one or more of audio information and video information of amusic performance at a given location, detecting means for detecting,concurrent with the acquiring or the one or more of audio informationand video information of the music performance, body motion informationindicative of a tempo of music of the music performance andbio-information of at least one individual present at the givenlocation, and first packetizing means for partitioning the acquired oneor more of audio information and video information of the musicperformance into lengths of partitioned data each of which correspondsto a predefined time interval, and for compressing and packetizing thelengths of partitioned data into a stream of first data packets havingempty regions resulting from the compression of the partitioned data,analysis means for performing statistical processing of the body motioninformation indicative of the tempo of the music of the musicperformance and bio-information over predetermined time intervalscorresponding to respective pluralities of the first data packets of theone or more of audio information and video information, secondpacketizing means for packetizing the statistically processed bodymotion information indicative of the tempo of the music of the musicperformance and bio-information into respective pluralities second datapackets corresponding to the respective pluralities of the first datapackets, and multiplexing means for multiplexing the stream of firstdata packets with the second data packets by inserting a respectiveplurality of second data packets, which corresponds to one of thepredetermined time intervals, into one of the empty regions of thestream that is adjacent to a respective plurality of first data packetswhich corresponds to a same one of the predetermined time intervals; aninformation reproducing apparatus, including; means for decomposing themultiplexed data stream into respective pluralities of first datapackets of one or more of audio information and video information of amusic performance and into corresponding respective pluralities ofsecond data packets of statistically processed body motion informationindicative of a tempo of music of the music performance andbio-information, the multiplexed data stream having each respectiveplurality of second data packets of the statistically processed bodymotion information indicative of the tempo of the music of the musicperformance and bio-information which corresponds to a givenpredetermined time interval being disposed adjacent to a respectiveplurality of first data packets which corresponds to a samepredetermined time interval in regions of the data stream resulting frompartitioning acquired one or more of audio information and videoinformation into lengths of partitioned data each corresponding to apredefined time interval and compressing the lengths of partitioneddata, the acquired one or more of audio information and videoinformation of the music performance being acquired at a performance ata given location, the body motion information indicative of the tempo ofthe music of the music performance and bio-information being of at leastone individual present at the given location and being detectedconcurrent with the acquiring or the one or more of audio informationand video information, the statistically processed body motioninformation indicative of the tempo of the music of the musicperformance and bio-information being generated by performingstatistical processing of the detected body motion informationindicative of the tempo of the music of the music performance andbio-information over predetermined time intervals corresponding torespective pluralities of the first data packets, means for reproducingthe one or more of audio information and video information of the musicperformance for delivery to a user, means for providing, to the user,sense stimulation based on the body motion information indicative of thetempo of the music of the music performance and bio-informationconcurrent with the delivery of the one or more of the audio informationand video information of the music performance, and means for generatingvideo information for a moving image in correspondence with the bodymotion information indicative of the tempo of the music of the musicperformance,
 34. The information reproducing apparatus as set forth inclaim 33, further comprising: means for receiving the multiplexed datastream through a transmission medium.
 35. The information reproducingapparatus as set forth in claim 33, further comprising: means forreading out the multiplexed data stream from a recording medium.
 36. Theinformation reproducing apparatus as set forth in claim 33, wherein theat least one individual includes a speaker, a player, an actor, or aconductor who serves as a source of the audio information, and/or aperformer or a photographed person who is included within the videoinformation.
 37. The information reproducing apparatus as set forth inclaim 33, wherein the at least one individual includes a listenerpresent at the given location when the audio information is acquiredand/or a viewer present at the given location when the video informationis acquired.
 38. A system, comprising: an information processingapparatus, including: information acquiring means for acquiring one ormore of audio information and video information of a music performanceat a given location, detecting means for detecting, concurrent with theacquiring of the one or more of audio information and video informationof the music performance, body motion information indicative of a tempoof music of the music performance and bio-information of at least oneindividual present at the given location, and first packetizing meansfor partitioning the acquired one or more of audio information and videoinformation of the music performance into lengths of partitioned dataeach of which corresponds to a predefined time interval, and forcompressing and packetizing the lengths of partitioned data into astream of first data packets having empty regions resulting from thecompression of the partitioned data, analysis means for performingstatistical processing of the body motion information indicative of thetempo of the music of the music performance and bio-information overpredetermined time intervals corresponding to respective pluralities ofthe first data packets of the one or more of audio information and videoinformation, second packetizing means for packetizing the statisticallyprocessed body motion information indicative of the tempo of the musicof the music performance bio-information into respective pluralities ofsecond data packets corresponding to the respective pluralities of thefirst data packets, and multiplexing means for multiplexing the streamof first data packets with the second data packets by inserting arespective plurality of second data packets, which corresponds to one ofthe predetermined time intervals, into one of the empty regions of thestream that is adjacent to a respective plurality of first data packetswhich corresponds to a same one of the predetermined time intervals; aninformation reproducing apparatus, including: means for decomposing themultiplexed data stream into respective pluralities of first datapackets of one or more of audio information and video information of amusic performance and into corresponding respective pluralities ofsecond data packets of statistically processed body motion informationindicative of a tempo of music of the music performance andbio-information, the multiplexed data stream having each respectiveplurality of second data packets of the statistically processed bodymotion information indicative of the tempo of the music of the musicperformance and bio-information which corresponds to a givenpredetermined time interval being disposed adjacent to a respectiveplurality of first data packets which corresponds to a samepredetermined time interval in regions of the data stream resulting frompartitioning acquired one or more of audio information and videoinformation of the music performance into lengths of partitioned dataeach corresponding to a predefined time interval and compressing thelengths of partitioned data, the acquired one or more of audioinformation and video information of the music performance beingacquired at a performance at a given location, the body motioninformation indicative of the tempo of the music of the musicperformance and bio-information being of at least one individual presentat the given location and being detected concurrent with the acquiringof the one or more of audio information and video information of themusic performance, the statistically processed body motion informationindicative of the tempo of the music of the music performance andbio-information being generated by performing statistical processing ofthe detected body motion information indicative of the tempo of themusic of the music performance and bio-information over predeterminedtime intervals corresponding to respective pluralities of the first datapackets, means for controlling, based on the body motion informationindicative of the tempo of the music of the music performance andbio-information, reproduction of the one or more of audio informationand video information of the music performance, and means for generatingvideo information for a moving image in correspondence with the bodymotion information indicative of the tempo of the music of the musicperformance.
 39. The information reproducing apparatus as set forth inclaim 38, further comprising: means for receiving the multiplexed datastream through a transmission medium.
 40. The information reproducingapparatus as set forth in claim 38, further comprising: means forreading out the multiplexed data stream from a recording medium.
 41. Theinformation reproducing apparatus as set forth in claim 38, wherein theat least one individual includes a speaker, a player, an actor, or aconductor who serves as a source of the audio information, and/or aperformer or a photographed person who is included within the videoinformation.
 42. The information reproducing apparatus as set forth inclaim 38, wherein the at least one individual includes a listenerpresent at the given location when the audio information is acquiredand/or a viewer present at the given location when the video informationis acquired.
 43. A system, comprising: an information recordingapparatus, comprising: information acquiring means for acquiring one ormore of audio information and video information of a music performanceat a given location, detecting means for detecting, concurrent with theacquiring of the one or more of audio information and video informationof the music performance, body motion information indicative of a tempoof music of the music performance and bio-information of at least oneindividual present at the given location, first packetizing means forpartitioning the acquired one or more of audio information and videoinformation of the music performance into lengths of partitioned dataeach of which corresponds to a predefined time interval, and forcompressing and packetizing the lengths of partitioned data into astream of first data packets having empty regions resulting from thecompression of the partitioned data, analysis means for performingstatistical processing of the body motion information indicative of thetempo of the music of the music performance and bio-information overpredetermined time intervals corresponding to respective pluralities ofthe first data packets of the one or more of audio information and videoinformation, second packetizing means for packetizing the statisticallyprocessed body motion information indicative of the tempo of the musicof the music performance and bio-information into respective pluralitiesof second data packets corresponding to the respective pluralities ofthe first data packets, multiplexing means for multiplexing the streamof first data packets with the second data packets by inserting arespective plurality of second data packets, which corresponds to one ofthe predetermined time intervals, into one of the empty regions of thestream that is adjacent to a respective plurality of first data packetswhich corresponds to a same one of the predetermined time intervals, andrecording means for recording the multiplexed stream onto apredetermined recording medium; and a non-transitory recording mediumhaving recorded therein the multiplexed data stream comprised ofrespective pluralities of first data packets of one or more of audioinformation and video information of a music performance andcorresponding respective pluralities of second data packets ofstatistically processed body motion information indicative of a tempo ofmusic of the music performance and bio-information, the multiplexed datastream having each respective plurality of second data packets of thestatistically processed body motion information indicative of the tempoof the music of the music performance and bio-information whichcorresponds to a given predetermined time interval being disposedadjacent to a respective plurality of first data packets whichcorresponds to a same predetermined time interval in regions of the datastream resulting from partitioning acquired one or more of audioinformation and video information into lengths of partitioned data eachcorresponding to a predefined time interval and compressing the lengthsof partitioned data, the acquired one or more of audio information andvideo information of the music performance being acquired at aperformance at a given location, the body motion information indicativeof the tempo of the music of the music performance and bio-informationbeing of at least one individual present at the given location and beingdetected concurrent with the acquiring of the one or more of audioinformation and video information, the statistically processed bodymotion information indicative of the tempo of the music of the musicperformance and bio-information being generated by performingstatistical processing of the detected body motion informationindicative of the tempo of the music of the music performance andbio-information over predetermined time intervals corresponding torespective pluralities of the first data packets.
 44. The recordingmedium as set forth in claim 43, wherein the at least one individualincludes a speaker, a player, an actor, or a conductor who serves as asource of the audio information, and/or a performer or a photographedperson who is included within the video information.
 45. The recordingmedium as set forth in claim 43, wherein the at least one individualincludes a listener present at the given location when the audioinformation is acquired and/or a viewer present at the given locationwhen the video information is acquired.
 46. The recording medium as setforth in claim 43, wherein the bio-information is selected from thegroup consisting of myoelectricity, body surface temperature, skinsweating, skin resistance, pulse, breath, micro-vibration,cardioelectricity, heartbeat, and blood pressure.